INTERACTIVE SYSTEM, INTERACTIVE METHOD, TWO-WAY 
INTERACTIVE SYSTEM, TWO-WAY INTERACTIVE METHOD AND 

RECORDING MEDIUM 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to an interactive system and an 
interactive method for conducting an interactive processing for interaction 
with a user, a two-way interactive system and a two-way interactive 
method for establishing communication between interactive systems, and a 
recording medium. 
Description of the Related Art 

As conventional interactive systems of this type, there are known, 
for example, a talkative parrot sounding device described in Japanese 
Patent Application Laid-Open Publication No. 11-9847 and an on-vehicle 
electronic equipment described in Japanese Patent Application Laid-Open 
Publication No. 6-239186. 

The talkative parrot sounding device converts a voice signal 
inputted as voice into a text using voice / text conversion means, adds a 
response attribute inputted by response attribute input means with the text 
as a talking-to text or a response text, and registers the response attribute in 
database. In response, the response text is retrieved while using the 
talking-to text which has been converted into a text from the voice / text 
conversion means and the response attribute from the response attribute 
input means as retrieval keys. The retrieved response text is converted 
into a voice signal by means for converting a response text into voice and 
outputted as voice from voice output means. Accordingly, it is possible to 
respond to talking-to by the same word or a specific word and to make the 
user feel as if an actual parrot is responding. 

Also, the on-vehicle electronic equipment stores a plurality of first 
language words, stores a plurality of second language words different from 
the first language words in response to the first language words in order to 
recognize speaker's voice, retrieves a second language word in a second 
language dictionary in response to a word recognized based on a first 
language, word, and synthesizes the retrieved word into voice to output it. 



By doing so, it is possible to prevent a driver from falling into a doze. 

Further, an interactive system for changing an internal state by a 
recognition word recognizing voice inputted from a user and changing a to- 
be-uttered word according to the changed internal state, is utilized in game 
5 equipment and the like. 

This interactive system has a microphone inputting a voice uttered 
by a user, a voice recognition / processing section recognizing the voice 
inputted from the microphone and converting the recognized voice into a 
symbol string, a conversation pattern processing section controlling a 
10 conversation with the user based on the symbol string converted by the 

voice recognition / processing section and outputting a symbol string suited 
3 for the user to a voice synthesis processing section, the voice synthesis 
H processing section converting the symbol string from the conversation 
y § pattern processing section into voice, and a speaker outputting and uttering 
^ 15 the voice from the voice synthesis processing section, 
j The conversation pattern processing section has a pattern driving 

= section and an internal model. The pattern driving section inputs a 

:J symbol string from the voice recognition processing section and outputs a 
; 0 symbol string corresponding to the inputted symbol string based on a 
^20 conversation pattern described in advance. If the pattern driving section 
O has detected, for example, a specific word, the internal model inputs trigger 
information from the pattern driving section, changes a model value 
indicating an internal state in response to the trigger information and 
outputs the changed model value to the pattern driving section. The 
2 5 pattern driving section inputs the model value from the internal model, 
refers to the model value during the processing of the conversation and 
changes words according to a conditional expression or the like described 
in a conversation pattern. 

Nevertheless, according to the conventional talkative parrot 
30 sounding device and the on-vehicle electronic equipment stated above, the 
voice word of the user is inputted and a preset word corresponding to the 
inputted word is outputted. Due to this, if the same word is inputted, the 
corresponding same word is outputted. Since logic for generating an 
outputted word from an inputted word is finite and the range of 
35 conversation is restricted if the number of outputted words is small, a user 
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is bored with the conversation. 

Further, according to the interactive system stated above, the model 
value can be changed and a word uttered by the system can be changed. 
However, the change of words depends on the rule held by the system and 
does not yet reach a level at which a user is not bored with conversation. 

SUMMARY OF THE INVENTION 
It is an object of the present invention to provide an interactive 
system, an interactive method, a two-way interactive system, a two-way 
interactive method and a recording medium capable of conducting an 
interactive processing which does not bore a user by changing words and 
the like uttered by the system and thereby realizing the removal of the 
boredom of the user such as a driver, the prevention of the user from falling 
into a doze and the like. 

To obtain the above objects, the present invention is constituted as 

follows. 

An interactive system recited in a first aspect is characterized by 
comprising: a voice input section inputting voice uttered by a user; a voice 
recognition processing section recognizing the voice inputted by the voice 
input section, and converting the recognized voice into an input symbol 
string; a conversation pattern processing section inputting the input symbol 
string from the voice recognition processing section, and outputting an 
output symbol string corresponding to the input symbol string based on a 
conversation pattern described in advance; a voice synthesis processing 
section converting the output symbol string from the conversation pattern 
processing section into voice; a voice output section outputting and uttering 
the voice from the voice synthesis processing section; and a conversation 
characteristic control section grasping conversation characteristics of the 
user based on the input symbol string from the conversation pattern 
processing section, and changing the output symbol string in accordance 
with the grasped conversation characteristics. 

According to the invention recited in the first aspect, the 
conversation characteristic control section grasps user's conversation 
characteristics based on the input signal string from the conversation 
pattern processing section and changes the output symbol string in 



accordance with the grasped conversation characteristics. Due to this, the 
system can conduct an interactive processing in accordance with the 
individual users' characteristics. It is, therefore, possible to conduct an 
interactive processing which does not bore the user and to thereby realize 
5 the removal of the boredom of the user such as a driver, the prevention of 
the user from falling into a doze and the like. 

An interactive system recited in a second aspect based on the first 
aspect is characterized in that the conversation characteristic control section 
optimizes a conversation topic, a conversation pattern, uttered words, a 
10 conversation response interval, utterance frequency and timing during the 
utterance based on words and a conversation pattern used by the user with 
«f high frequency, a specific topic, times of conversation responses and 
:n utterance time and the number of words uttered by the user. This allows 
!~ the system to conduct an interactive processing in accordance with the 
>ii 5 characteristics of individual users. 

% An interactive system recited in a third aspect is characterized by 

I comprising: a voice input section inputting voice uttered by a user; a voice 
recognition processing section recognizing the voice inputted by the voice 
input section, and converting the recognized voice into an input symbol 
;io string; a conversation pattern processing section inputting the input symbol 
JJ string from the voice recognition processing section, and outputting an 

output symbol string corresponding to the input symbol string based on a 
conversation pattern described in advance; a voice synthesis processing 
section converting the output symbol string from the conversation pattern 
25 processing section into voice; a voice output section outputting and uttering 
the voice from the voice synthesis processing section; a storage section 
storing synonyms and relevant words synonymous with and relevant to 
words uttered by the user; and an association function section extracting the 
synonyms and relevant words synonymous with and relevant to words 
30 uttered by the user from the storage section based on the input symbol 

string from the conversation pattern processing section, and outputting the 
extracted synonyms and relevant words to the conversation pattern 
processing section. 

According to the invention recited in the third aspect, the 
35 association function section extracts synonyms / relevant words 
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synonymous with and relevant to the words uttered by the user based on the 
input symbol string from the conversation pattern processing section and 
outputs the extracted synonyms / relevant words to the conversion pattern 
processing section. Thus, the system can select the next top.c which the 
5 user appears to be able to associate from the contents of the conversion 
held so far and make an active utterance when the chain of interaction is 
broken This can make the active utterance of the interactive system 
conversation not at random but having fixed continuity. Accordingly, it is 
possible to conduct an interactive processing which does not bore the user 
10 and thereby realize the removal of the boredom of the user such as a driver, 

the prevention of a user's doze and the like. 
□ An interactive system recited in a fourth aspect is characterised by 

?1 comprising: a voice input section inputting voice uttered by a user; a , tat 
5 voice recognition processing section recognizing the vorce inputted by the 
lis voice input section, and converting the recognized voice into a .first. input 
* symbol string; a conversation pattern processing sectron inputtmg the first 
W input symbol string from the first voice recognition processing section and 
E* outputting an output symbol string corresponding to the first input symbol 
'?, string based on a conversation pattern described in advance; a voice 
Jo synthesis processing section converting the output symbol string from the 
g conversation pattern processing section into voice; a voice output section 
' J outputting and uttering the voice from the voice synthesis processing 
section; a second recognition processing section recognizing broadcast 
voice from a broadcast station, and converting the recognized broadcast 
25 voice into second input symbol strings; and an event data storage section 
storing the second input symbol strings as event data. 

According to the invention recited in the fourth aspect, the second 
voice recognition processing section recognizes broadcast voice from the 
broadcast station, converts the recognized broadcast voice into the second 
30 input symbol string, and stores the second input string in the event data 
storage section as event data. Namely, by acquiring the event data the 
system can provide the data which the direct user does not have. Further, 
since data can be acquired from voice broadcasting, it is possible to acquire 
event data at low cost without the need to provide a special device 
35 An interactive system recited in a fifth aspect based on the fourth 
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aspect is characterized by comprising an event data processing section 
extracting only a symbol string desired by the user among the second input 
symbol strings converted by the second voice recognition section, and 
storing the extracted symbol string in the event data storage section. 
5 According to the invention recited in the fifth aspect, the event data 

processing section extracts only a symbol string desired by the user among 
the second input symbol strings converted by the second voice recognition 
section, and stores the extracted symbol string in the event data storage 
section. Due to this, it is possible to acquire only the symbol string 
10 desired by the user and it suffices that the system has a low storage 
capacity. 

'5 An interactive system recited in a sixth aspect based on the fourth 

:5 or fifth aspect, is characterized by comprising a conversation characteristic 
!fl control section grasping conversation characteristics of the user based on 
Ml 5 the input symbol string from the conversation pattern processing section, 
;J and changing the output symbol string in accordance with the grasped 
J conversation characteristics. 

The invention recited in the sixth aspect can obtain the advantage of 
py the invention recited in the first aspect in addition to the advantage recited 
;io in the fourth aspect. 

P An interactive system recited in a seventh aspect based on the 

fourth aspect, is characterized by comprising: a storage section storing 
synonyms and relevant words synonymous with and relevant to words 
uttered by the user; and an association function section extracting the 
25 synonyms and relevant words synonymous with and relevant to words 
uttered by the user from the storage section based on the input symbol 
string from the conversation pattern processing section, and outputting the 
extracted synonyms and relevant words to the conversation pattern 
processing section. 

30 The invention recited in the seventh aspect can obtain the advantage 

of the invention recited in the third aspect in addition to the advantage 
recited in the fourth aspect. 

A two-way interactive system recited in an eighth aspect 
comprising a plurality of interactive systems each conducting an interactive 

35 processing for interaction with a user, the respective interactive systems 
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communicating with one another, is characterized in that each of the 
interactive systems comprises: a voice input section inputting voice uttered 
by a user; a voice recognition processing section recognizing the voice 
inputted by the voice input section, and converting the recognized voice 
5 into an input symbol string; a conversation pattern processing section 
inputting the input symbol string from the voice recognition processing 
section, and outputting an output symbol string corresponding to the input 
symbol string based on a conversation pattern described in advance; a voice 
synthesis processing section converting the output symbol string from the 
10 conversation pattern processing section into voice; a voice output section 
outputting and uttering the voice from the voice synthesis processing 
i section; an event data transmission and reception section transmitting the 
IP input symbol string to the other interactive system as event data, and 

receiving event data consisting of the symbol string from the other 
hfi5 interactive system; and an event data storage section storing the event data 
:£ received by the event data transmission and reception section from the 
* other interactive system. 

'£J According to the invention recited in the eighth aspect, the event 

FU data transmission and reception section transmits the input symbol string to 
another interactive system as event data, receives event data consisting of a 
5 symbol string from the other interactive system, and stores the event data 
received from the other interactive system in the event data storage section. 
Namely, systems mutually transmit and receive event data, whereby a 
system can acquire data from a plurality of systems and easily increase the 
2 5 quantity of data which can be collected. 

A two-way interactive system recited in a ninth aspect based on the 
eighth aspect, is characterized by comprising: an input section inputting a 
privacy protection command of the user; and a privacy protecting function 
section transmitting the event data acquired by utterance of the user to the 
30 other interactive system if the privacy protection command is not inputted 
from the input section, and not transmitting the event data acquired by the 
utterance of the user to the other interactive system if the privacy protection 
command is inputted from the input section. 

According to the invention recited in the ninth aspect, the privacy 
35 protecting function section transmits the event data acquired by the 
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utterance of the user to the other interactive system if the privacy protection 
command is not inputted from the input section, and does not transmit the 
event data acquired by the utterance of the user to the other interactive 
system if the privacy protection command not inputted from the input 
5 section. It is, therefore, possible to suppress the contents and the like 
which the user oneself is uttered to the system from being inadvertently 
transmitted to other systems. 

A two-way interactive system recited in a tenth aspect based on the 
eighth aspect, is characterized by comprising: a conversation characteristic 
10 control section grasping conversation characteristics of the user based on 
the input symbol string from the conversation pattern processing section, 
Jj and changing the output symbol string in accordance with the grasped 
'0 conversation characteristics. 

^ The invention recited in the tenth aspect can obtain the advantage of 

^b.5 the first aspect in addition to the advantage recited in the eighth aspect. 

J A two-way interactive system recited in an eleventh aspect based on 

the eighth aspect, is characterized by comprising: a storage section storing 
j=3 synonyms and relevant words synonymous with and relevant to words 

uttered by the user; and an association function section extracting the 
r=20 synonyms and relevant words synonymous with and relevant to words 
O uttered by the user from the storage section based on the input symbol 

string from the conversation pattern processing section, and outputting the 

extracted synonyms and relevant words to the conversation pattern 

processing section. 
25 The invention recited in the eleventh aspect can obtain the 

advantage of the third aspect in addition to the advantage recited in the 

eight aspect. 

A two-way interactive system recited in a twelfth aspect based on 
the eighth aspect, is characterized by comprising: a second recognition 
30 processing section recognizing broadcast voice from a broadcast station, 
and converting the recognized broadcast voice into second input symbol 
strings; and an event data storage section storing the second input symbol 
strings as event data. 

The invention recited in the twelfth aspect can obtain the advantage 
35 of claim 4 in addition to the advantage recited in the eighth aspect. 
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An interactive method recited in a thirteenth aspect is characterized 
by comprising: a voice recognition processing step of recognizing voice 
uttered by a user, and of converting the recognized voice into an input 
symbol string; a conversation pattern processing step of inputting the input 
symbol string, and of outputting an output symbol string corresponding to 
the input symbol string based on a conversation pattern described in 
advance; a voice synthesis processing step of converting the output symbol 
string into voice; a voice output step of outputting and uttering the voice 
obtained in the voice synthesis processing step; and a conversation 
characteristic control step of grasping conversation characteristics of the 
user based on the input symbol string, and of changing the output symbol 
string in accordance with the grasped conversation characteristics. 

An interactive method recited in a fourteen aspect based on the 
thirteenth aspect, is characterized in that the conversation characteristic 
control step optimizes a conversation topic, a conversation pattern, uttered 
words, a conversation response interval, utterance frequency and timing 
during the utterance based on words and a conversation pattern used by the 
user with high frequency, a specific topic, times of conversation responses 
and utterance time and the number of words uttered by the user. 

An interactive method recited in a fifteenth aspect is characterized 
by comprising: a voice recognition processing step of recognizing voice 
uttered by a user, and of converting the recognized voice into an input 
symbol string; a conversation pattern processing step of inputting the input 
symbol string, and of outputting an output symbol string corresponding to 
the input symbol string based on a conversation pattern described in 
advance in a conversation pattern processing section; a voice synthesis 
processing step of converting the output symbol string into voice; a voice 
output step of outputting and uttering the voice obtained in the voice 
synthesis processing step; a storage step of storing synonyms and relevant 
words synonymous with and relevant to words uttered by the user; and an 
association function step of extracting the synonyms and relevant words 
synonymous with and relevant to words uttered by the user from the 
storage section based on the input symbol string, and of outputting the 
extracted synonyms and relevant words to the conversation pattern 
processing section. 
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An interactive method recited in a sixteenth aspect is characterized 
by comprising: a first voice recognition processing step of recognizing 
voice uttered by a user, and of converting the recognized voice into a first 
input symbol string; a conversation pattern processing step of inputting the 
5 first input symbol string, and of outputting an output symbol string 
corresponding to the first input symbol string based on a conversation 
pattern described in advance; a voice synthesis processing step of 
converting the output symbol string into voice; a voice output section 
outputting and uttering the voice obtained in the voice synthesis processing 
10 section; a second recognition processing step of recognizing broadcast 
voice from a broadcast station, and converting the recognized broadcast 
55 voice into second input symbol strings; and an event data storage step of 
ffi storing the second input symbol strings as event data, 
irj An interactive method recited in a seventeenth aspect based on the 

i ! J.5 sixteenth aspect, is characterized by comprising an event data processing 
m step of extracting only a symbol string desired by the user among the 

second input symbol strings converted in the second voice recognition step, 
5 and of storing the extracted symbol string in the event data storage section. 
TU An interactive method recited in an eighteenth aspect based on the 

H§ o sixteenth or seventeenth aspect, is characterized by comprising a 
□ conversation characteristic control step of grasping conversation 
characteristics of the user based on the input symbol string, and of 
changing the output symbol string in accordance with the grasped 
conversation characteristics. 
25 An interactive method recited in a nineteenth aspect based on the 

sixteenth aspect, is characterized by comprising: a storage step of storing 
synonyms and relevant words synonymous with and relevant to words 
uttered by the user; and an association function step of extracting the 
synonyms and relevant words synonymous with and relevant to words 
30 uttered by the user from the storage section based on the input symbol 

string, and of outputting the extracted synonyms and relevant words to the 
conversation pattern processing section. 

The invention recited in a twentieth aspect is a two-way interactive 
method of allowing a plurality of interactive systems each conducting an 
35 interactive processing for interaction with a user to communicate with one 
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another, and is characterized by comprising: a voice recognition processing 
step of recognizing the voice uttered by a user, and of converting the 
recognized voice into an input symbol string; a conversation pattern 
processing step of inputting the input symbol string, and of outputting an 
5 output symbol string corresponding to the input symbol string based on a 
conversation pattern described in advance; a voice synthesis processing 
step of converting the output symbol string into voice; a voice output 
section outputting and uttering the voice obtained in the voice synthesis 
processing step; an event data transmission and reception step of 
10 transmitting the input symbol string to the other interactive system as event 
data, and of receiving event data consisting of the symbol string from the 

!jj other interactive system; and an event data storage step of storing the event 

j =0 data received from the other interactive system. 

£5 A two-way interactive method recited in a twenty first aspect based 

on the twentieth aspect, is characterized by comprising: an input step of 
S inputting a privacy protection command of the user; and a privacy 
; s protecting function step of transmitting the event data acquired by utterance 
% of the user to the other interactive system if the privacy protection 
I'U command is not inputted from the input section, and not transmitting the 
J4o event data acquired by the utterance of the user to the other interactive 
□ system if the privacy protection command is inputted from the input 
section. 

A two-way interactive method recited in a twenty second aspect 
based on the twentieth aspect, is characterized by comprising: a 

25 conversation characteristic control step of grasping conversation 
characteristics of the user based on the input symbol string, and of 
changing the output symbol string in accordance with the grasped 
conversation characteristics. 

A two-way interactive method recited in a twenty third aspect based 

30 on the twentieth aspect, is characterized by comprising: a storage step of 
storing synonyms and relevant words synonymous with and relevant to 
words uttered by the user; and an association function step of extracting the 
synonyms and relevant words synonymous with and relevant to words 
uttered by the user from the storage section based on the input symbol 

35 string, and of outputting the extracted synonyms and relevant words to the 
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conversation pattern processing section. 

A two-way interactive method recited in a twenty fourth aspect 
based on the twentieth aspect, is characterized by comprising: a second 
recognition processing step of recognizing broadcast voice from a 
broadcast station, and of converting the recognized broadcast voice into 
second input symbol strings; and an event data storage step of storing the 
second input symbol strings as event data. 

The invention recited in a twenty fifth aspect is a computer readable 
recording medium for recording a program for allowing a computer to 
execute by comprising: a voice recognition processing step of recognizing 
voice uttered by a user, and of converting the recognized voice into an 
input symbol string; a conversation pattern processing step of inputting the 
input symbol string, and of outputting an output symbol string 
corresponding to the input symbol string based on a conversation pattern 
described in advance; a voice synthesis processing step of converting the 
output symbol string into voice; a voice output step of outputting and 
uttering the voice obtained in the voice synthesis processing step; and a 
conversation characteristic control step of grasping conversation 
characteristics of the user based on the input symbol string, and of 
changing the output symbol string in accordance with the grasped 
conversation characteristics. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of the functions of an interactive system 
in the first embodiment according to the present invention; 

FIG. 2 is a block diagram of the hardware of the interactive system 
in the first embodiment; 

FIG. 3 shows an event data table provided in the interactive system 
in the first embodiment; 

FIG. 4 shows an event attribute table provided in the interactive 
system in the first embodiment; 

FIG. 5 is a flow chart showing an interactive method realized by the 
interactive system in the first embodiment; 

FIG. 6 is a flow chart showing the processings of a conversation 
learning section provided in the interactive system in the first embodiment; 



FIG. 7 is a flow chart showing the processings of an internal model 
provided in the interactive system in the first embodiment; 

FIG. 8 is a block diagram of the functions of an interactive system 
in the second embodiment according to the present invention; 
5 FIG. 9 is a flow chart showing an interactive method realized by the 

interactive system in the second embodiment; 

FIG. 10 is a block diagram of the functions of a two-way interactive 
system in the third embodiment according to the present invention; 

FIG. 11 is a flow chart showing an interactive method realized by 
10 the two-way interactive system in the third embodiment; and 

FIG. 12 is a block diagram of the functions of a two-way interactive 
3 system in the fourth embodiment according to the present invention. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 
%5 Description will be given hereinafter to the embodiments of an 

S interactive system, an interactive method, a two-way interactive system, a 

two-way interactive method and a recording medium according to the 
;jj present invention, with reference to the accompanying drawings. 
[First Embodiment] 

=4o FIG. 1 is a block diagram of the functions of an interactive system 

3 in the first embodiment. FIG. 2 is a block diagram of the hardware of the 
interactive system in the first embodiment. The interactive system shown 
in FIG. 1 is mounted on a vehicle and holds a voice conversation with a 
user such as a driver. 
25 The interactive system has a microphone 1 inputting voice uttered 

by a user, a voice recognition processing section 3 recognizing the voice 
inputted from the microphone 1 and converting the recognized voice into a 
symbol string (corresponding to an inputted symbol string), a conversation 
pattern processing section 5 controlling the conversation with the user 
30 based on the symbol string converted by the voice recognition processing 
section 3 and outputting a symbol string (corresponding to an outputted 
symbol string) suited for the user to a voice synthesis processing section 7, 
the voice synthesis processing section 7 converting the symbol string from 
the conversation pattern processing section 5 into voice, and a speaker 9 
35 outputting and uttering the voice from the voice synthesis processing 
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section 7. 

The conversation pattern processing section 5 corresponds to a 
conversation characteristic control section and has a pattern driving section 
31, a calendar (clock) 32, a sensor value conversion processing section 33, 
5 an internal model (psychological model) 34, a pattern database 35, a word 
dictionary 36 and an event database 37. 

The pattern driving section 31 inputs a symbol string from the voice 
recognition processing section 3 and outputs a symbol string corresponding 
to the inputted symbol string based on a conversation pattern described in 
io advance. The conversation pattern described in advance is a pattern in 

which the inputted symbol string corresponds to a symbol string to be 
! outputted and stored in the pattern database 35. 

} The interactive system processes not only the voice made by a user 

j but also inputs from external sensors. The external sensors involve an 
optical sensor 11 detecting light, a temperature sensor 12 detecting 
temperature, a vibration sensor 13 detecting vibration, a calendar 32 
^ indicating dates and the like. A/D converters 14a to 14c are provided to 
S correspond to the optical sensor 11, the temperature sensor 12 and the 
S vibration sensor 13, respectively. Each of the A/D converters 14a to 14c 
,«£ o numerically converts a sensor signal (analog signal) from the 
□ corresponding sensor into a digital signal and outputs the converted 

numerical information to the sensor value conversion processing section 33. 
The pitch, tone quality and the like of the voice from the microphone 1 may 
be numerically converted into a digital signal by the A/D converter and the 
2 5 obtained numerical information may be outputted to the sensor value 
conversion processing section. 

The sensor value conversion processing section 33 converts 
numeric values (sensor values) from the A/D converters 14a to 14c into 
variables, respectively, and outputs the variables to the pattern driving 
30 section 31. The pattern driving section 31 deals with the numeric 

information and calendar information as variables, refers to these variables 
while processing conversation, and influences conversation flow and the 
like according to the conditional expression described in the conversational 
pattern. 

The internal model 34 deals with a reaction accompanied by 



35 



14 



passage of time while the pattern driving section 31 deals with reactions for 
individual conversations. The internal model 34 inputs trigger 
information from the pattern driving section 31 if the pattern driving 
section 31 has detected, for example, a specific word, changes a model 
5 value indicating an internal state in response to the trigger information and 
outputs the changed model value to the pattern driving section 31 as a 
variable. The internal model 34 also performs a processing while 
referring to event data from the event data table 37. 

The pattern driving section 31 inputs the variable from the internal 
10 model 34, refers to the variable while processing conversation, changes the 

word according to a conditional expression described in a conversation 
| pattern, and influences conversation flow and the like. The pattern 
S driving section 31 also stores information acquired from the user during 
3 conversation in the event database 37 as event data, or refers to event data 
1 5 from the event database 37. The interactive system cites part of the event 
n data when making a voice and refers to the event data when interpreting the 

content of user ' s utterance . 
3 The event database 37 has a event data table 38 storing event data 

*j as shown in FIG. 3, and an event attribute table 39 storing event attributes 
:|o as shown in FIG. 4. The event data table 38 consists of a registration 
3 timestamp representing event data registered time, the acquisition means of 
the event data such as the system, the user and character broadcasting, the 
number of event data, data [0] of event data = data name, data [1] = 
attribute 1 and data [2] = attribute 2. Each of the data name, the attribute 
25 1 and the attribute 2 consists of an attribute identifier (attribute ID) 
represented by an ID number and an attribute value. 

In the event attribute table 39, attribute IDs and attribute names are 
stored for the respective attributes of events while being associated with 
one another as shown in FIG. 4. For example, if the attribute ID is ' 1001 ', 
30 the attribute name is "name of player: baseball'. In the event data table 38, 
if the attribute ID is '1001', 'name of player: Shinjo' is stored as an 
attribute value. 

Further, the interactive system has a conversation learning section 
41 and a learning database 43. The conversation learning section 41 
35 grasps conversation characteristics/topics and the like which are considered 
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to be desirable for a user and controls the pattern driving section 31 based 
on the characteristics / topics thus grasped. 

Due to this, the conversation learning section 41 utilizes, as 
evaluation indexes, a word used by the user with high frequency and the 
5 type of the word, a conversation pattern used by the user with high 

frequency, the continuity of conversation with respect to a specific topic / 
conversation content (the number of responses of conversation) and 
utterance time, the number of uttered words and the like of the user based 
on the input and output symbol strings from the pattern driving section, the 
10 trigger from the pattern driving section 31 and the variable from the 

internal model 31. Then, the conversation learning section 41 optimizes 

i* s 

3 the conversation topic / conversation pattern / uttered words, the selection 
5 of word type, response interval (average conversation interval) of the 
3 system, the frequency / timing of active utterance from the system side and 
b % 5 the like when the system utters. The pattern learning section 41 then 
5 outputs an average conversation interval and the like to the pattern driving 
: ! , section 31 and outputs a trigger to the internal model 34. 
□ The conversation learning section 41 also holds the inputted 

[H information and generated information in the learning database 43 as 
r|o learning data and refers to the learning data held by the learning database 
'3 43. The word dictionary 36 stores words, which words are read by the 
pattern driving section 31. 

Next, in the hardware block diagram of the interactive system 
shown in FIG. 2, an A/D converter 2 converts voice from the microphone 1 
2 5 into a digital signal and outputs the digital signal to a bus 15. A D/A 

converter 8 converts a symbol string from the bus 15 into an analog signal 
and outputs the analog signal to the speaker 9. A central processing unit 
(CPU) 17 executing processings, a random-access memory (RAM) 19, a 
read-only memory (ROM) 21 serving as a recording medium storing a 
30 control program for conducting a conversation processing, a mass storage 
memory 23, such as a hard disk, storing data are connected to the bus 15. 
The mass storage memory 23 is a storage device including the pattern 
database 35, the word dictionary 36, the event database 37 and the learning 
database 43 already described above. The control programs stated above 
35 may be stored in a CD-ROM or the like instead of the ROM 21. 
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Each of the voice recognition processing section 3, the voice 
synthesis processing section 7, the pattern driving section 31, the sensor 
value conversion processing section 33, the internal model 34 and the 
conversation learning section 41 is a function realized when the CPU 17 
5 executes the control program stored in the ROM 21. 

Next, one example of the processings of the conversation learning 
function of the conversation learning section 41,which is the characteristic 
feature of the first embodiment, will be described with reference to FIG. 5. 
Using FIG. 5, logic for learning an appropriate conversation interval will be 
10 described. 

First, a time tO is set at a present time (in a step SI), and an overall 
'$ interval of conversation Msum is set at '0' and the times of conversations N 
5 is set at '0' (in a step S3). Next, if the symbol string from user's utterance 
sj or the variable by the sensor signal from the optical sensor 11 or the like 

5 are inputted into the pattern driving section 31, a trigger is outputted from 
m the pattern driving section 31 to the conversation learning section 41 and 

the detection of the trigger is, therefore, carried out (in a step S5). 
q If a trigger is detected (YES in a step S7), it is then determined 

ilJ whether the trigger is a system utterance start trigger (e.g., discriminated by 
,|o a flag '01 ') (in a step Sll). If the trigger is a system utterance start trigger, 
O it is then determined whether the number of words uttered by the user is 
larger than a predetermined number (in a step S13). 

If the number of words is larger than the predetermined number, a 
conversation interval M is obtained by subtracting the time tO from the 
25 present time (in a step S15) and the time tO is set as the present time (in a 
step S17). Further, the conversation interval M is added to the overall 
conversation interval Msum and the obtained value is set as the overall 
conversation interval Msum (in a step SI 9). 

Next, the number N is incremented only by '1' and the obtained 
30 number is set as N (in a step S21). The overall conversation interval 
Msum is divided by the number N and the obtained value is set as an 
average conversation interval M0 (in a step S23). Then, the average 
conversation interval M0 is stored in the learning database 43 as the 
variable of the pattern driving section 31 (in a step S25). Also, the 
35 average conversation interval M0 is outputted to the pattern driving section 
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31 as a variable. Thereafter, the processing returns to the step S5 and the 
processings from the steps S5 to S25 are repeated. 

If no trigger is detected in the step S7, the determination result of 
the step Sll is NO and the determination result of the step S13 is NO, then 
5 the processing instantly returns to the step S5. 

As can be seen from the above, if the number of words uttered by 
the user is large, the conversation learning section 41 judges that the 
average conversation interval is appropriate, grasps and outputs the average 
conversation interval to the pattern driving section 31 as a variable. The 
10 pattern driving section 31 refers to the average conversation interval as a 
variable and outputs a symbol string to the voice synthesis processing 
is section 7 at the average conversation interval, 
ffj Namely, the conversation learning section 41 grasps the 

%j conversation characteristics / topics and the like which appear to be 
^3.5 appropriate for the user from the interaction between the user and the 
JK interactive system, and controls the pattern driving section 31 using the 
grasped characteristics / topics. Therefore, the interactive system can 
n perform an interactive processing in accordance with the characteristics of 
fU individual users. Accordingly, it is possible to perform an interactive 
,»io processing which does not bore the user and to thereby realize the removal 
□ of the boredom of the user such as a driver, the prevention of the user from 
falling into a doze and the like. Further, the CPU 17 executes the control 
program recorded on the ROM 21 serving as a recording medium, whereby 
it is possible to realize the processings of the conversation learning section 

25 41. 

The data communication between the conversation learning section 
41 and the pattern driving section 31 has been described above. Next, the 
data communication between the conversation learning section 41 and the 
internal model 34 will be described. First, referring to FIG. 6, the 
30 processings of the conversation learning section 41 will be described. 
Initially, a mode evaluation value is initialized (in a step S31) and it is 
determined whether a trigger is detected from the pattern driving section 31 
(in a step S33). 

If a trigger is detected (YES in a step S35), it is then determined 
35 whether the trigger is a system utterance start trigger (in a step S3 7). If 



the trigger is a system utterance start trigger, it is then determined whether 
the number of words uttered by a user is larger than a predetermined 
number (in a step S39). 

If the number of words is larger than the predetermined number, a 
5 conversation mode continuation request trigger (e.g., discriminated by a 
flag '10') is issued (in a step S41), and the processing returns to the step 
S33. If no trigger is detected in the step S35, the determination result is NO 
in the step S37 and the determination result is NO in the step S39, then the 
processing instantly returns to the step S33. 
10 Next, referring to FIG. 7, the processings of the internal model 34 

will be described. First, a model value is initialized (in a step S51) and a 
la model value Mx is set at £ 0' (in a step S52). Then, a trigger is detected 
L -J from the conversation learning section 41 (in a step S53). 
5 If a trigger is detected (YES in a step S55), it is then determined 

j tl5 whether the trigger is a system utterance start trigger (in a step S57). If 
m the trigger is not a system utterance start trigger, it is then determined 

whether the trigger is a conversation mode continuation request trigger (in 
q a step S59). 

TU if the trigger is a conversation mode continuation request trigger, a 

|o subtraction value is subtracted from the model value Mx and the obtained 
3 value is set as a new model value Mx (in a step S61). The processing 
returns to the step S53. 

In the step S57, if it is determined that the trigger is a system 
utterance start trigger, it is then determined whether the conversation mode 
2 5 has been changed (in a step S63). If the conversation mode has been 
changed, an addition value is added to the model value Mx and the 
obtained value is set as a new model value Mx (in a step S65). Then, the 
processing returns to the step S53. If the conversation mode has not been 
changed in the step S63, the model value Mx is set at '0' (in a step S67) 
30 and the processing returns to the step S53. In this way, the model value of 
the internal model 34 can be changed by the trigger from the conversation 
learning section 41 and the changed model value can be inputted, as a 
variable, into the conversation learning section 41. 
[Second Embodiment] 
35 Next, an interactive system and an interactive method in the second 
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embodiment will be described. 

FIG. 8 is a block diagram of the functions of the interactive system 
in the second embodiment. The interactive system in the second 
embodiment is characterized by being provided with an association 
5 function section 45 and a synonym / relevant word dictionary 47 instead of 
the conversation learning section 41 and the learning database 43 shown in 
FIG. 1. 

The remaining constituent elements of the interactive system shown 
in FIG. 8 are the same as those of the interactive system in the first 
10 embodiment shown in FIG. 1. The same elements are denoted by the 

same reference symbols as those in the first embodiment and no description 
■M will be given thereto. 

: J The synonym / relevant word dictionary 47 stores synonyms and 

5 relevant words synonymous with and similar to words uttered by a user and 
%5 those uttered by the system. 

5 The association function section 45 extracts words relevant to 

f , conversation from the synonym / relevant word dictionary 47 based on 
5 inputted and outputted symbol strings from the pattern driving section 31a 
[H or the classification of words in the inputted and outputted symbol strings 
iljo obtained while referring to a word dictionary 36, and outputs the extracted 
13 synonym / relevant word group to the pattern driving section 31a as 
variables. Namely, the association function section 45 refers to the 
synonym / relevant word dictionary 47, extracts synonyms and relevant 
words related to the words uttered by the user or those uttered by the 

2 5 system during conversation, and determines the content of system active 

utterance using the extracted synonyms / relevant words or the 
classification of the words. 

Further, the association function section 45 selects an appropriate 
word from the word dictionary 36 based on conversation history 

3 o information just before the stop of the chain of conversation when the chain 

of conversation is stopped (when the conversation is temporarily stopped), 
extracts words relevant to the selected word while referring to the synonym 
/ relevant word dictionary 47, and outputs the extracted words to the pattern 
driving section 31a. At the time of the next system active utterance (i.e., 
35 when the system makes an active utterance), the interactive system utters 
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voice including the extracted words or event data including the extracted 
words. 

Next, a concrete example of the processings of the association 
function section 45 will be described. In this example, logic for obtaining 
5 synonyms of a word appearing with high frequency will be described with 
reference to FIG. 9. First, a word history is initialized (in a step S73) and 
a trigger is detected from the pattern driving section 31a (in a step S75). 

Next, if a trigger is detected (YES in the step S75), it is then 
determined whether the trigger is a conversation end trigger (e.g., 
10 discriminated by a flag ' 11 ') (in a step S77). If the trigger is a 

conversation end trigger, words in the conversation are added to the word 
2 history (in a step S79). Then, a word group W [] appearing with high 
i: 5 frequency in the word history is created (in a step S81). 
%j Next, a synonym group S [] is initialized (in a step S83) and I is set 

j! ;i5 at '0' (in a step S85). Synonyms / relevant words of the word group W [I] 
5 are retrieved from the synonym / relevant word dictionary 47 (in a step 

S87) and the word group obtained as a result of the retrieval are added to 
□ the synonym group S [] (in a step S89). 

[H Then, I is incremented only by 4 1 ' (in a step S91) and it is 

r:io determined whether I becomes equal to or larger than the number of words 
a of the word group W [] (in a step S93). If I is smaller than the number of 
words of the word group W [], the processing returns to the step S85. 

If I becomes equal to or larger than the number of words of the 
word group W [], the word group W [] and the synonym group S [] are 
25 stored as variables of the pattern driving section 31a (in a step S95) and the 
processing returns to the step S73. If no trigger is detected in the step S75 
and the determination result of the step S77 is NO, then the processing 
instantly returns to the step S73. 

Next, concrete examples of the word group W [] and the synonym 
30 group S [] will be described. For example, it is assumed that the word 
history is {UEHARA (2), GIANTS (3), noodle (2), weather (3) ...}. 
These items are rearranged into word groups as follows. Weather = 44 
points {weather, forecast, fine, cloudy, maximum temperature ...}, baseball 
= 38 points {UEHARA, GIANTS, strikeout, pitcher, ...}, food = 13 points 
3 5 {noodle, lunch, curry, beer, . . . } . If "weather" is selected as a word group 
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appearing with high frequency, the word group W [] = {weather, forecast, 
fine, cloudy, maximum temperature, ...}. 

Next, synonyms / relevant words of the respective words in the 
word group W [] are extracted as follows. Weather — * {atmospheric 
5 condition, meteorology, fine}, forecast — * {weather forecast}, fine — * 
{good weather, fine autumn day, bright and clear weather, fair}, cloudy — ► 
{cloud, clouded sky}. When a group of synonyms is generated, the 
synonyms S [] = {atmospheric condition, meteorology, fair, weather 
forecast, good weather, fine autumn day} 
10 The word group W [] and the synonym group S [] thus obtained are 

referred to by the pattern driving section 31a as variables. When the 
Jq interactive system utters actively, the words relevant to the conversation 
; a J? thus far as well as event data including the words are retrieved and uttered, 
sj In this way, the association function section 45 can select the next 

|J ls topic which appears to be able to be associated by the user from the content 
m of the conversation thus far and give active utterance when the chain of the 
;^ conversation is broken. This can make the active utterance of the 
q interactive system conversation held not at random but having fixed 
[H continuity. Accordingly, it is possible to conduct an interactive processing 
i Jo which does not bore the user and thereby realize the removal of the 
G boredom of the user such as a driver, the prevention of the user from falling 
into a doze and the like. Further, the CPU 17 executes the control 
program recorded on the ROM 21 serving as a recording medium, whereby 
the processings of the association function section 45 can be realized. 

2 5 [Third Embodiment] 

FIG. 10 is a block diagram of the functions of a two-way interactive 
system in the third embodiment. The two-way interactive system in the 
third embodiment is provided with an interactive system 70 conducting an 
interactive processing for interaction between the system and a user, a 
30 broadcast station 71 and a two-way intellectual conversation system 73. 

The two-way intellectual conversation system 73 is the same in constitution 
as the interactive system 70. The interactive system 70 and the two-way 
intellectual conversation system 73 communicate with each other. 

In addition, the interactive system 70 is characterized by being 

3 5 provided with an event data acquisition section 49, an event data 
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processing section 53, an event data transmission / reception section 55, a 
privacy protecting function section 59, a switch 61 and the like instead of 
the conversation learning section 41 and the learning database 43 shown in 
FIG. 1, and by acquiring event data from voice broadcasting and event data 
5 from a low power radio device in addition to event data by the user's 
utterance. 

The remaining constituent elements of the two-way interactive 
system shown in FIG. 10 are the same as those of the interactive system in 
the first embodiment shown in FIG. 1. Therefore, the same elements are 
10 denoted by the same reference symbols and description will not be given 
thereto. 

2 Unlike data acquisition (VICS and the like) by character 

i: 2 broadcasting (FM multiplex broadcasting) and data acquisition by mobile 
Q communication (portable telephone / PHS and the like), the event data 
] %5 acquisition section 49 converts a voice signal of TV / radio broadcasting 
i;n from the broadcast station 71 into data by voice recognition and acquires 

the data as event data. The even data acquisition section 49 has a 
!□ broadcast reception device 50 and a voice recognition processing section 
| U 51. The broadcast reception device 50 receives voice broadcasting from 
; jp the broadcast station 71, and the voice recognition processing section 51 
£3 converts a voice signal included in the received voice broadcasting into a 

symbol string. 

The event processing section 53 extracts data from the symbol 
string from the voice recognition processing section 51 according to a 
25 specific pattern (a rule described differently from an ordinary conversation 
pattern), and stores the extracted data in the event database 37b as event 
data. 

Thus, the interactive system 70 can provide event data which a 
direct user does not have, to the user. Further, since the interactive system 
30 70 can acquire event data from the voice broadcasting, the system 70 can 
acquire event data at low cost without the need to provide a special device. 

Alternatively, the event data processing section 53 may extract only 
the data desired by the user from the symbol string from the voice 
recognition processing section 51, and store the extracted data in the event 
35 database 37b as event data. If so, only the event data desired by a user is 
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stored in the event database 37b and it suffices that the event database 37b 
has low storage capacity. 

On the other hand, the event data transmission / reception section 
55 transmits and receives event data to and from the two-way intellectual 
5 conversation system 73. The event data transmission / reception section 
55 has a low power radio device 56 and a transmission / reception control 
section 57. The low power radio device 56 transmits and receives event 
data to and from the two-way intellectual conversation system 73 over 
radio wave. The transmission / reception section 57 controls the 
10 transmission and reception of event data; i.e., transmits the event data 

received by the low power radio device 56 to the event database 37b 
=3 through the event data processing section 53 and transmits event data from 
the privacy protecting function section 59 to the two-way intellectual 

□ conversation system 73 through the low power radio device 56. 
'"Is If the switch 61 is turned on, the switch 61 inputs a privacy 

,;h protection command to the privacy protecting function section 59 so as to 
; 5 s suppress the transmission of event data on user's privacy uttered by the 

□ user. The privacy protecting function section 59 sends the event data 

| H acquired by user's utterance to the transmission / reception control section 
i^o 57 if no privacy protection command is inputted from the switch 61, and 
O does not send the event data acquired by the user's utterance to the 
transmission / reception control section 57 if the privacy protection 
command is inputted from the switch 61. 

Next, the event data transmission / reception functions of the event 
25 data transmission / reception section 55 will be described. First, when the 
event data transmission / reception section 55 transmits a fixed carrier wave 
to the two-way intellectual conversation system 73, the two-way 
intellectual conversation system 73 transmits a response wave to the event 
data transmission / reception section 55 in response to the carrier wave. 
30 When receiving the reception wave from the two-way intellectual 

conversation system 73, the event data transmission / reception section 55 
establishes communication with the two-way intellectual conversation 
system 73 through certain communication procedures. 

The systems between which communication has been established, 
35 transmit data request bidirectionally. Data requirements (such as retrieval 
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conditions and the range of date and time) are added to the data request. 
For example, if the two-way intellectual conversation system 73 receives a 
data request, the system 73 transmits requested data (which means data 
conforming to requirements if such requirements are designated). In turn, 
5 at the data requesting side or the interactive system 70 side, for example, 
the event data transmission / reception section 55 receives the data and 
stores the received data in the event database 37b through the event data 
processing section 53. 

Further, the interactive system 70 receives an event data 
10 transmission request on specific conditions from the two-way intellectual 
^ conversation system 73, the event data transmission / reception section 55 
»ij transmits event data according to the request to the two-way intellectual 
^ conversation system 73. 

y As can be seen, the event data transmission / reception section 55 of 

l %5 a system having the low power radio device 56 transmits and receives 
m event data to and from another system, whereby the interactive system 70 
;\; can acquire data from a plurality of other systems and easily increase the 
;;3 quantity of data which can be collected. 

! w : Moreover, while the communicable range of the lower power radio 

i;20 device 56 is relatively narrow, it is possible to transfer data even between 
Q systems distant from each other by a degree which exceeds the 

communicable range of the low power radio device 56 itself if data is 
transferred through a plurality of chained systems. If part of or all of the 
systems are mounted on a mobile body such as a vehicle, in particular, the 
25 range in which data is transmittable can be easily widened. 

If data is received from another system, each system may store the 
received data in the event database 37b even without going through 
procedures for the establishment of communication. 

Next, the logic of the privacy protecting function for event data will 
30 be described with reference to FIG. 11. First, a transmission event E [] to 
be transmitted from the interactive system 70 to the two-way intellectual 
conversation system 73 is initialized (in a step S101) and I is set at '0' (in a 
step SI 03). Then, it is determined whether a privacy protecting function 
is turned on or off depending of whether the switch 61 is turned on or off 
35 (in a step S105). If the privacy protecting function is turned on, the 
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planned transmission event is set at K and the type of EO [I] is determined 
(in a step S107). 

Next, it is determined whether the planned transmission event K is 
uttered by a user (in a step S109). If the planned transmission event K is 
5 not uttered by the user, E0[I] is added to E[I] (in a step Sill) and I is 
incremented only by 'V (in a step S113). If it is determined that the 
planned transmission event K is uttered by the user in the step S109, the 
processing instantly moves to the step SI 13. 

It is then determined whether I is equal to or larger than the number 
10 of elements of EO [] (in a step S115). If I is smaller than the number of 
_ elements of EO [], the processing returns to the step S107 and the 

processings from the steps S107 to S115 are repeated. If I is equal to or 
; ! L; larger than the number of elements of EO [], the transmission event E [] is 

"i'xsr 

%j outputted to the transmission / reception control section 57 (in a step S117). 
l l5 On the other hand, if it is determined that the privacy protecting 

iTi function is turned off in the step S105, the transmission event E [] is 
:^ outputted to the transmission / reception control section 57 as it is (in a step 
q S119). Namely, the event data which has been checked by the privacy 
j ,~ protecting function section 59 is transmitted to the two-way intellectual 
iftO conversation system 73 through the low power radio device 73 by the 
! = 3 transmission / reception control section 57. 

As can be understood from the above, if the user issues a privacy 
protection command by either the switch 61 or voice or if the privacy 
protecting function section 59 receives a request from another system, the 
25 section 59 does not transmit the event data acquired by user's utterance. 
In other words, the privacy protecting function can suppress the content 
which the user oneself uttered to the system or the like from being 
inadvertently transmitted to other systems. It is noted that the event data 
received from voice broadcasting or from other systems are transmitted. 
30 Furthermore, the CPU 17 executes the control program recorded on 

the ROM 21 serving as a recording medium, whereby it is possible to 
realize the processings of the voice recognition processing section 51, the 
event data processing section 53, the transmission / reception control 
section 57 and the privacy protecting function section 59. 
35 [Fourth Embodiment] 
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Next, a two-way interactive system and a two-way interactive 
method in the fourth embodiment will be described. FIG. 12 is a block 
diagram of the functions of the two-way interactive system in the fourth 
embodiment. The two-way interactive system in the fourth embodiment 
is a combination of the interactive systems in the first and second 
embodiments and the two-way interactive system in the third embodiment. 

The two-way interactive system in the third embodiment can obtain 
the advantages of the interactive systems in the first and second 
embodiments and those of the two-way interactive system in the third 
embodiment. 

It is noted that the present invention should not be limited to the 
interactive systems in the first and second embodiments and the two-way 
interactive systems in the third and fourth embodiments. Needless to say, 
the present invention is also applicable to an interactive system which is a 
combination of the interactive system in the first embodiment and that in 
the second embodiment, a two-way conversation system which is a 
combination of the interactive system in the second embodiment and the 
two-way interactive system in the third embodiment and a two-way 
interactive system which is a combination of the interactive system in the 
first embodiment and the two-way interactive system in the third 
embodiment. 

Moreover, each of the interactive systems in the first and second 
embodiments and the two-way interactive systems in the third and fourth 
embodiments is mounted on a vehicle and holds interaction with a user 
such as a driver. The present invention is also applicable to a nursing care 
system for elderly people and the like. The present invention is further 
applicable to a two-way nursing care system for establishing 
communication between a plurality of nursing care systems. In short, as 
long as the system is an interactive system for holding interaction with 
users, the present invention is applicable to other systems. 



